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Abstract 



Cloning, or approximate cloning, is one of basic operations in quantum 
information processing. In this paper, we deal with cloning of classical 
states, or probability distribution in asymptotic setting. We study the 
quality of the approximate (n, rn)-clone, with n being very large and r 

^ ■ being constant. 

qH' The resuh turns out to be ||N(0,rl) -N(0, l)||j, where N (/i, E) is 

the Gaussian distribution with mean /j, and covariance E. Notablly, this 
value does not depend on the the family of porbability distributions to be 

^ ' cloned. 

The key of the argument is use of local asymptotic normality: If the 
curve S — > Pe is sufBciently smooth in 9, then, the behavior of P^" where 

f^ ■ 6' — 6 — o I ^/TJnj, is approximated by Gaussian shift. Using this, we 

reduce the general case to Gaussian shift model. 

1 Introduction 

Cloning, or approximate cloning, is one of basic operations in quantum informa- 
tion processing. It is related to optimal eavesdropping of quantum key distribu- 
K> ' tion, and also to optimal estimation efficiency. The quality of the approximate 

» . clone, thus, has been studied extensively ^. 

In this paper, we deal with cloning of classical states, or probability distri- 
butions in asymptotic setting. The study of (approximate) cloning of classical 
states had started even earlier than the proposal of no-cloning theorem, to give 
a measure of information contained in additional observations : they studied 
the quality of approximate {n + r)-copies made from n-copies {{n,n + r)-clone, 
hereafter), with n being very large and r being constant [5] [5] [5]. 

This paper explores another direction: we study the quality of the approx- 
imate (n,m)-clone with n being very large and r being constant, since its ex- 
tension to quantum system seems to be easier. 



A-;(P,")-Pr -D^r,j~^- (2) 



In the argument, we make full use of local asymptotic normality: If the curve 
—^ Pg is sufficiently smooth, then, the family \ Pf", _i/2 f is approxi- 

mated by Gaussian shift |N [h, Jg )}i,pRmi where Je is the Fisher information 
matrix of {-Pejege ^^ ^- Using this fact , we reduce the general case to the 
Gaussian shift model . More concretely, letting -D^.s be the loss of optimal 
(1, r)-cloner of the Gaussian shift {N (h, S)}^gjj„, we show 

sup hm inf sup ||A (P,'!) - P,™||i > D^^ j-., (1) 

a>On-^oo A. || e'_6l|| <an-i/2 ' <* 

where A moves over all the Markov maps. In other words, the loss of the 
optimal asymptotic (n, nr)-cloner is asymptotically lower-bounded by D^ j-i, 
at each 9 Cz O. This loss turns out to be achievable: we construct a doner A^'J 
with 

limlini lim 

SIO eiO n-i-oo 

Also, we find more explicit expression of Dr^Y., which is 

i?,,s = ||N(0,rl)-N(0,l)||i. 

It is notable that DrY. does not depend on S. This means that D ,-i, 
the smallest asymptotic loss of (n, rri)-cloner, docs not depend on the family 
{Pe}eeB to be cloned. 

Since there is a (finite dimensional) quantum version of local asymptotic 
normality, this argument may be extended to finite dimensional quantum case. 

The paper is organized as follows. First, we give the optimal approximate 
doners for Gaussian shift families, and find some properties of them. Second, we 
state local asymptotic normality of smooth family of probability distributions, 
and its uniform version. Finally, we give asymptotic analysis of approximate 
(n, rn)-clone of smooth families. The paper is concluded by discussions. 

2 Gaussian shift family 

2.1 Reduction of cloning to amplification 

The contents of the subsection is well-known, but added for the sake of comple- 
tion. 

Consider the Gaussian shift family {N (/i, E)}^,^™. Then, the problem of 
optimum approximate (l,r)-clone, or finding a map achieving 



Cr.T. '■= inf sup 

AiMarkov fi(z]^rn 



A(N(/t,E))-N(/i,S)^'' 



is equivalent to finding the optimum r-amplifier, or a Markov map achieving 
DrY-= inf sup ||A(N(/t,E))-N(Vf/i,S)|l . (3) 

AiMarkov ;igR™ " "^ 



To see this, let Xi, • • • , Xr ^ N (/i, E), and 



^i — 2^ Oi^jXj 

where O is an orthogonal matrix with Oii = Oi_2 

X; - N (V^/i, S) and X^, • • • , X; - N (0, E). 
Therefore, if 



Oi, 



-^. Then, 



sup 



Ao(N(/i,E))-N(/i,E) 



(g)r 



— Cr.T. + e, 



then 



sup ||*oAo(N(/i,E))-N(V^/i,E)|| <a.s+e, 



where ^ is a Markov map corresponding to application of O followed by restric- 
tion to the first variable. Hence, 

On the other hand, let ^' be a Markov map corresponding to the map 

followed by Q-^ . If 

sup II Ai (N (/i, E)) - N (VF/i, E) II = D,.s + e, 



then 



Hence, 



sup 



*'oAi(N(/i,E))-N(/i,E)^ 



C'r^E < -Dr^E- 



< A-,E + £. 



After all, we have Cr,s = Dr^T,- 

2.2 Amplifier for Gaussian shift families 

In this subsection, we find the optimum r-amplifier (r > 1) and its loss -D^.e 
Cr.E for the Gaussian shift family {N [h, E)}^gjj™. 
Observe first that 

*^ (N {h, E)) = N (V7/i, rE) , *^-i/2 (N (^f/i, rE)) = N (/i, E) . 

where ^^ describes the Markov map corresponding to scale change. Hence, 

Dr^^ < inf sup II A o *^ (N (h, E)) - N {^h, E) || ^ 

= inf sup ||A(N(Vf/i,rE)) -N(Vf/i,E)||^ 

^ heR"» 



and 

Dr,s = inf sup II A 0*^-1/2 (N(v^/i,rE)) -N(v^/i,S)|| 

>inf sup ||A(N(Vf/i,rE)) - N (^f/i, E) ||^ . 



Thus, 



i:'r,s = inf sup ||A(N(^/f;^,rS))-N(Vf/^,E)||^, (4) 

and A!^j, achieving ([3]) and A'' achieving ^ are, if exists, related by 



A'' = A'' o * ^ 



Now, we refer to Theorem 3 of [TT] : applying to our case, it says that 
Dr.s = sup If (y) po.s (y) dy - sup / / (y + ^/rx) po.rE (y) dy \ 

f.snpjf(x)\<l U ^ J J 

= sup inf <^ / /(y){po.E(y)-Px.rs(2/)}dy 

/:supj/(a;)|<l ^ U 

= sup inf M /(y){po,i(y)-Px.ri(2;)}dy 

/:™pj/(^)l<i "= U 

where Px,i: is probability density function of N (a;, S). 

The right most side of (O is evaluated as follows. Observe 



(5) 



DrX < inf ||po,l -Px.rlMt 

X 

= lbo,l -PO.rllli ■ (6) 

(The proof of ([6]) is in the appendix.) On the other hand, define Br := 
{y ;pi (y) > pri (y)}, which is a ball centered at origin. Then, 



Dr,^ ^ ™M y (2^s. (y) - 1) {^0,1 (y) - Px,ri (y)} dy 

(2/b, (y) - l)po,i (j/)dy - sup / {2Ib, (y) - l)px,ri iy)dy 

X J 

(2/b^ (y) - l)po,i (y) dy- f (2/b„ (y) - l)po,,.i (y) dy 



= ||P0,1 -PO.rllli- (7) 

(N.B. in the case of r < 1, sup^. / {2Ib^ (y) — l)px.ri (y) dy is achieved as ||a::|| — >• 
00.) 

After all, we have, if r > 1, 

Dr^^ - llPoa -Po,ri\\, = ||N (0, 1) - N (0, rl)\\^ . (8) 

Obviously, corresponding A'' is the identity map. Thus, 



2.3 Bounded shifts 

Define 

-Dr,s,a :=inf sup llA (N (/i, S)) - N (/i, V^S) 11 

Then, ii a' > a and 

sup II A (N {h, S)) - N {h, V^E) 11^ = Z?,,E,a' + e, 

\\h\\<a' 

then 

sup II A (N (h, S)) - N {h, VfS) II < DrX,a' + s. 

\\h\\<a 

Since £ > can be arbitrary, therefore, 

Hence, since D^.^^a < 2, hm£i_j.tx) Dr^T,,a exists. 
Lemma 1 

hm Dr.S.o = Dr,S- 

a— ^oo 

Proof. Let us consider a decision problem taking values in [—1, 1] . Let p be 
a Markov kernel from R™ to [-1, 1]"'", and F {h, ■) : MJ^ ->■ [-1, 1] be a lower 
continuous function. Also, we define Va be the set of probability distributions 
over {x; ||a;|| < a} with finite support. Then, we define, for tt G Va, 

Rt, (S, F,p):= F {h, a) p (da, x) ph^ri: {x) Axd-K (h) . 

Due to the randomization criteria (Theorem 1.10 of [5], Theorem 55.9 of [TU]). 



and 



DrT, = sup sup < inf Rt^ (rE, F, p) — inf i?7r (S, F, p) > , 

Dr,T..a = sup sup <^ inf Rj: {r'E, F, p) - inf R^{T.,F,p)\ . 
^eVa F { P P J 

Comparing the right hand sides of them, 

Dr,Y, = SUpi'r.S.a = Um £'r,E,a- 

a>0 ■ '^^°° 



3 Smooth family 

3.1 Settings and description of results 

Consider a family of probability distributions {Pe',6 G 0} over the measurable 
space (ri, X), where Q is an open region in R"*, fi is a Polish space (a separable 
completely metrizable topological space, e.g. W^, Z*^, etc. ) , and Pe has density 
pe with respect to a measure /i. Define Pg" := P^'\ p^ := pf", fi" := fi^", 
X" := <Y^", and 






Pe+hn-^/2 



Also, Eg and Eg refers to expectation with respect to Pg or Pg, respectively. 
Wg,K {k = I,--- ,n) are the random variables with Wg^^ ^ Pe, and define 
W^ := (VFe,i, • • • , Wg.n), which obeys P^". 

Under this setting, we investigate the quality of (n, rir)-clonc of {Pg; 9 e O}. 
More specifically, we show 

sup hm ;nf sup ||A"^- (PJS) - P^ll, > D ^^ = D ., 

(10) 
which means the loss of the optimal asymptotic (n, nr)-cloner is lower bounded 
by D ,-1, at each 6 ^<d. Also, we show this loss is achievable: we construct a 
doner A^'J with 



limlim lim 

i5^0 e^O ra->oo 



At^w)-pr =Dr.j,^- (11) 

1 ■ '^ 



3.2 Local asymptotic normality and its uniform version 

The map — >■ pe is differ entiahle in quadratic mean, if 

lim — ^ / v^^- VP^- ^^ev^ d^i = 0, V0 e 9. (12) 

"-^-o \\ri\\ J \ ^ / 

If the map 9 ^ £g is continuous, we say 9 ^ pg is continuously differentiable in 
quadratic mean. 

We define, with w" G fi" and w^ e fi, 

Je := [Ee4_j4j], and 

-^e,/i (a;) := exp f h'^x - -h^ Jgh 
The following Lemma is recasting of Remark 1 of [3] and Theorem 7.2 of 



Lemma 2 Suppose Q is an open region in R™ and 9 ^ pg is continuously 
differ entiable in quadratic mean. Then, Figlg — 0, and, for any compact set 
K C e and K' C M™, 

lim sup sup Pe" { lln Z^\ - In Zg h (ig) I > e} = 0, Ve > 0. 

The following Lemma is recasting of Remark 1 of Theorem 7.2 of |12) . 

Lemma 3 Suppose O is an open region in M™ and 9 ^ pg is differentiable in 
quadratic mean. Then, Eglg = 0, and, for any compact set K' C M™, 

lim sup Pg" { lln Z^\ - In Zg h (ig) I > e| = 0, Ve > 0. 

In addition, we assume the following conditions: 

Jg is continuous in 9, (13) 

inf ag > 0, (14) 

where ag is the minimum eigenvalue of Jg, and 

sup Ege''^''" < oo, \/he M", for any compact set K cQ. (15) 

e<£K 

Observe that 

Eg {h^tgf' < {2k)l Whf'' Eg COSh {e'^ Ig) , 

Eg \h^£g\^''' < Whf''-' [l + Eg (e^^^)""} < \\hf'-' {1 + i2k)lEg cosh {e^£g) } 
where e = h/ \\h\\, implying 

sup Eg Ih'^lgl < oo, V/i G M™, for any compact set K C 0. (16) 

Also, one can show that, for any compact set K C Q and K' C M™, 

sup Eee'*"'^* < e''"''^'''', V6' e 6, V/i G iiT', Bn^.K' (17) 

">nA'.A-' 

The proof of p7)) is as follows. Observe, since Eg£g = due to Lemma[31 

l + ^^^+/rem(e,/l,n)) , (18) 



where 



\frc-m{9,h,n)\ 



fc=3 






A;>3. 



2 '^^ \ a/71 

A;>3.fc:cvcn 



1 /||/i|iv , (fc+i)! /ii/iir'^ 



fc>3,/c:odd 

oo 



A:! 



kl 



Eg cosh e 



fc>3 



l/^ll 






/i|iy 4-5||/i||/v^ 



(EeC0she^4 + l) 



(19) 



/^J l-||/i||/V« 
Therefore, for each compact set K C Q and K' C K™, there is tik^k' such that 



Hence, we have (fTT]). 

Also, we use the foUowing identity : 

hm sup sup sup Eg 
which is proved as foUows. 



g/«^£?.gh^C>a 



= 0, 



(20) 



hm sup sup sup Eg 



^h^r, . ^h^r, > ^ 



< hm sup sup sup yEg [e^''^'^»] PJ* {e'*^^e > a} 



< hm sup sup sup e^'* ■'o^Jp^{e^'^^'S>a] 



< hm sup sup supe2''^"'»''W-E^e''^^« 

< hm - sup sup e^'^ '^"''^ — 0. 
a^oo a heK'OeK 

Lemma 4 Suppose random variables Xn,t , and Yn^t, n > 1, t ^ T , taking 
values in R*^' satisfies 



hm supPr{||X„.t-r„,(|| > e} = 0, 

n->oo (g^ 



(21) 



Let f be a continuously differentiable function from R*^ to R such that, 



and 



Then, 

Proof. Define 
Then, 



sup |lV,/(x)|| <(», (22) 

x:f{x)<.a 



lim lim siipE [/ (X„,t) : / {Xn,t) > a] < oo, (23) 

a— J-cxD n— J-cxD i^'j' 

lim lim supE [/ (Xn.t) : / {Yn,t) > a] < oo. (24) 

a— >-oo n— J-CJO ^^ j^ 



lim sup|E/(X„,0-E/(r„,t)|-0 

n-s-oo jgg. 



r(a;):=/(x)Aa. 



lim sup|E/(X„,t)-E/(y„,t)| 

< lim sup|Er(X„,t)-Er(Xt)| 

+ lim sup|E[/(X„.t):/(X„.t)>a]| 

+ lim sup |E [/ (Ynj.) : / (r„,t) > a] | . (25) 

The first term of the right hand side is evaluated as follows. 

\r (x„,t) - r (r„,0l < c \\x^,t - Yr,4 , vt e r 

where 



C< sup |1V,/(:e)|1<^. 

a;:/(2:)<a 



Therefore, 



lim sup |E/" {X,,,t) - E/" (y„,t)| < £ + a X lim supPr{|/'' (X„,t) - /" (y„,OI > e} 

= e + a X lim sup Pr {C |X„ j — F„ 1 1 > e} 

n-foo jg^ 



This can be made arbitrarily small, since e > is arbitrary. 

The second and the third terms of the right hand side of ( [25|) can be made 
arbitrarily small by taking a large. Hence, we have the assertion. ■ 

Lemma 5 Suppose 6 ~> pg is continuously differentiable in quadratic mean, 
and I115\) holds. Then, for any compact set K d Q and K' C R™, 

lim sup sup E^ |Z^\ - Ze,h {Q)\ = 0. 
"^°° heif' eeif 



Proof. We apply LemmaUl with f (x) := e^, t — {9,h), Xn,t '■= In-^^e'/i ^-nd 
r„,t := InZg^hi^e) = ^^^C " \h^ Jeh. Then, the premises dH]) and ^ are 
obviously satisfied. 

Due to (HOI), (ESI) is satisfied: 

lim sup sup E^ [Ze.h (O : ^e.h (C) > a] ^ 0, a ^ oo. 

(|24p is proved as follows. Let ga {x) be a continuous function on M+ such 
that (7a {x) =^ 1 for a:; < a — 1 and g^ (a;) = for x> a. Then, 

lim sup supE^[Z,\ ■.Zl^>a] 

< hm sup sup {1 - E',' [Zl^ .9, {Zl^ )] } 

ri^oo ^g^, gg^ 

< lim sup sup {1 - E^ [Zg^n (ig) 9a {Zg^^ (C) )]} 

"^°° /iGK' 9eK 
+ sup {(a; + e) 5^ (x + e) - xga (x)} 

X 

+ a lim P,"{|Z^\-Z9,„(C)| >e} 

< lim sup sup E^ [Ze.,. (C) : ^e./. (C) > a - 1 ] 
"^^•^ h<£K' eeK 

+ sup {(a; + e) 5q (x + e) - xga (a;)} 

+ a lim Pe"{|Z^^,-Ze.,,(C)| > e} 

= hm sup sup E^' [Zgj, (f^) ■■ Zg,h (C) > « - 1 ] 

+ sup {(a; + e) ga [x + e) - xga (a;)} . 

X 

Since e > is arbitrary and ga is continuous, 

hm sup sup E^ [Zl^ : Z^',, > a] 
n^°° heK' eeK 

< lim sup sup E^' [Ze,/. (C) : Zg,h (ig) >a-l] 
"^°° heK' eeK 

— > 0, a — > 00. 

So, we have the assertion. ■ 

Lemma 6 Suppose 6 ^ pg is differentiable in quadratic mean, and 111 5]) holds. 
Then, for any compact set K' C K™, 

lim supE^|Ze\-Ze,^(C)|=0. 

Proof. The proof is almost parallel with the one of LemmajSJ except that 
Lemma[3]is used instead of Lemma[2]and that supgg^^- at each step is removed. 
■ 

Below, we denote by C {h,r) the closed m-dimensional hypercube which is 
centered at /i € R™, parallel to the coordinate axis, and of edge length 2-r. Also, 
2-fe^m jg ^j^ element of R™ whose coordinates are integer multiple of 2^^ . 



10 



Lemma 7 Let Qq he a countable subset of Q and c„ be a positive constant. 
Then, to every ordered correction {ii, 12, • • • , ik) associate a Borel set 5'(ij_i2.... .i^) 
in R™ such that 

%i,i2,--»fc) f^'S'o-ij^.-Jfc) =<^' («i,«2,--- ,ik)7^{ji,J2,--- ,jk), (26) 

Diameter 0/%,,,,...,,,) < 7^2-'=+^ (fc > 1) , (27) 

P," {C e a%,.,,..,.,)} = 0, V0 e eo,Vn (28) 

U 5, D [-c„, €„]" , iV„ := (2c„ + 1)" , (29) 

00 

U Sj = R", (30) 

5"* 

U %ir-,^fc-i,i) = ^i.-'-ifc-i)- (31) 

i=i 

Proof. Since 0o is a countable set, we can choose an tq with c„ < ro < c„ + ^ 
and 

Pe"{^0 e C(0,ro)} = 0, V0 e eo,Vn. (32) 

Also, we can choose r^ with 2^*^ < r^ < 2^^^+^ and 

Pe"{£^eC(;i,rfe)}=O,V0eeo,Vn, (33) 

for ah h e 2-'=+iZ'". 

First, we compose Si, S2, ■■■■ Define hj G Z™ so that /ii,- • • ,/iAr^ S 
[— c„,c„] , and that {/ij ; j = 1, 2, • • • } = Z™. Then, recursively define, for 



J-1 ~| 

C(/i„ri)-U5, 



^1 :=C(0,ro)nC(/ii,ri), S^j :=C(0,ro)n 

and, for j > Nn + 1, 

^,:=C(/i„ri)-U^,. 

Since Ujl"i C (/ij,2-i) = C (0,c„ + i), we have Ujl"i ^ (^j,^i) ^ C(0,ro) . 
Also, 

U^, =C(0,ro)n<^UC(/.„ri) 
Therefore, 

iV„ 

|j5j=C(0,ro)D[-c„,c„]", 
11 



indicating P^. Similarly, we have 

OO OO CXD 

|J5, =C(0,ro)U y 5,=C(0,ro)U |J C{hj,n) 

OO . 

D[-c„,c„]"U U CU„- 

j=N„ + l ^ 

which is (pO)) . 

Next, we compose 5'(ij^..._j^) . For each k> 2, let hi^^... ^i^ (i^ = 1,- • • , 5™) be 
an element of 2-'=+iZ'" with /lij,... ,,, € C (/i^i,... ,,,_i, 2-'=+2^. Then, we define, 
recursively, 

^i,--- ,ifc„i,l) '■= S{ii,--- ,ifc-i) ^ C* (/lii,... ,ifc_i,l, ?^fc) , 

Sin,■■■,^k) — %i,---,»fc-i) ri < C'(/^n,---,«fc-i,ifc:''fc) - U 'S'(Ji,---,ifc-ij) 

Since 

U '5'(ji,...,,fc_ij) 3 y C(/i,i,...^j^_,j, 2"'=) 

= C (/J.,,.. ,.,_,, 2-^-+2 + 2-'=) 
and 

C {h,,,.. ,,,_, , 2-^-+2 + 2-^-) D C (/i,,,.. ,,,_, , r,_i) D %,,.. ,,,_,), 
we have 

5™ 

J=l 

which implies ([3T|) . 

(I26p is trivial by composition. ((27|) is due to 



Hence, by ([5^ and ([55]) . recursively we have (P5|. (|27p is obvious from that 
^in,---,ik) is asubset of C(/iji,...,j^,rfe). ■ 

Lemma 8 Suppose 6 ^ pg is continuously dijferentiable in quadratic mean, 
and 111 5]) holds. Also, let Oq be a countable subset o/O. Then, there are ran- 
dom variables rjg and rjg (n > I) over ([0, 1] ,B {[0,1] x R™) , i/), such that v is 
Lebesgue measure, 

C{7jeW)^'NiO,Jg), Ci7j^W)^C{e^\P^), (34) 

lim sup i^{\\v0-Ve\\>e}^O. (35) 



12 



Proof. Let 5'(ij_... i^) be as of Lemma[71 and for each k, and order 

{{n,--- ,^k)■,ileN,l<^J < 5"} 

lexicographically. For 6 G Oq, define intervals Ag (ii, • • • , ik) of the form [a, b) 
in [0, 1) such that the length of A^ (ii, • • • , it) is Pg {tg G S(^i^^... ^i^^-^], and that, 
with (ji, • • • , jfe) > (ii, • • • , ik), the left end point of A^ (ji, • • • ,jk) lies to the 
right of Ag (ii, • • • ,ik)- Then, we have 

U A^(zi, •-.,«,) = [0,1). 

iieN,l<ij<5™ 

If P^ {^g G "^(ii.-- .j„)} is non-zero for some n, by (pS)) . its interior is non- 
empty. Thus we may take a point xu-^^... i^\ in its interior. For vj G [0,1], 
define 

%•'' (m) := a;(,i_...^,^), w S Ag {ii,--- ,ik). 

Then, 

■ ve'" M - %"■'=+'=' m|| < ^M2-^•+^ (36) 

making the sequence < rf^' (tn) > Cauchy for each tu,ri, and 9. Hence, rf^ (tu) := 

limfe^oo ?7e ^ (^) exists. 

Define the intervals Ag (ii, • • • , i^.) of the form [a, 6) in [0, 1) such that the 
length of Ag (ii, • • • ,1^) is Pn(o,J(,) ('^'(ii,- ,i„)): and that, with (ji, • • • ,jk) > 
[}!,■■■ ,ife), the left end point of Ae (ji, •• • ,:/fc) lies to the right of Ag (zi, •• • ,Zfe). 
Also, one can define ry^ {zu) and -qe {ju) in the parallel manner with rf^j'' " {w) and 

Then, by ([28]) and the multi-dimensional Berry Esseen theorem (Corollary 
11.1 of [!,), we have 

sup |j/(A0 (zi,--- ,ife)) -i/(Ae(ii,--- ,ife))| < —=, 
eeKnSo v^ 

where /3 := 400m^/'* supgg^ E^ || J~^£g || .Therefore, 

z.(A^(zi,... ,zfe)AA,(zi,... ,zfe))< Ji_2. 



Also, by Markov's inequality, 

E -(A^(j))<^^^^^^^f^^, E H^o{j))<'-^^^^^^ 

Thus, 

sup E ^ (^e (*i> • • • , Jfc) A Ag (ii, • • • , ik)) 

^ 2supgg;^trJe /35^'"'' ((2c„ + I)'" -t-l)' 
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Here, set 



Then, 



rv — Kri 



Inn 
16m In 5 ' 



c„ := ni8" 



sup 
eeKnOo 



iieN,l<ij<5'" 



= O (n-^^ + O [n-^^-^] -^ 0, 
Therefore, 

Hm sup !/|?7g'''" (nj) =^?7^" (zu)] 



9eKnea 



< hm sup y ^/(A^(^l,••• ,ZfcJAAe(ii,--- ,zfcj)=0. (37) 



'^^-'^neN,i<J3<5" 
Observe, due to (l36t 



hm 

k' ^oo 



= hm 






?7e (to) - 77^" (to) 
Therefore, due to 

||%"(^)-r/.(TO)|| 

< -q^ (to) - T?^'''" (to) + ?7g ■''" (to) - ?7g" (to) + 77g" (to) - -qe (to) 



and (|57| . we have 



sup v{\\ri'S-r]e\\>e} 



< sup v < 

eeKneo ^ 

— )• 0, n — )• 00, 



n,kn fc„ 



2V^2-''-+^ > e 



which is (|55]) . 

To prove (1341) . observe that every open set in M'" can be expressed as a 
disjoint countable unionof S'(jj^ ... .ifc)'s. Therefore, for any open set G, by Fatou's 
lemma, 

Ijm i^ U''" e g} > P^^ {r^ e G} . 



fc— foo 



Hence, by Portmanteau theorem (Lemma 2.2 of |12|). limfc_>.oo 'C 1 77^ ' |z/] = 

C {ig\Pg). Since limfc^oo '7^' — Ve almost surely, we have the second identity 
of (|34p . The first identity is proved parallelly. ■ 
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Lemma 9 Suppose 9 ^ pg is continuously dijferentiable in quadratic mean, and 
I115\) holds. Also, let Qq be a countable subset ofQ. Then, there are probability 
measure Pg over a measurable space (fi" x fi'jA""® A"), where {i}',X') := 
(R™ X [0,1],S(]R™ X [0,1])), n > 1, and random variables A'", n > I over 

[f]" X fi', A"" (g) X',PA, such that, P^ is an extension of P^ and 

A'" ^ N (0, Je) , (38) 

lim sup Fg" {lie " A'"|| > £} = 0, (39) 



n,-> cogging 



for any compact set K d Q. 

Proof. The proof much draws upon the second proof of Lemma 2.2 of pT . Define 
a kernel KJ} (x, dy) from (M™, B (R™)) to ([0, 1] , fi ([0, 1])) by the identity 

,5,„(,) {dx) V {dy) = i?^ (da;) K^g {x, dy) , (40) 

where Sy is Dirac measure, v is the Lebesgue measure, rjg is as of Lemma|8l and 
Rg =C (f^lPg") = C {tj^Iv). (Since [0, 1] is Polish, such KJ} exists, see 342E of 
g]. ) Define, with w" = {uj'\x,y) G fl" x n', 

P," (dcD") := P," (dc.") <5,.(^„) (dx) A^ (x, dj/) , 
A'" (cD") := r,, (y) , 

where yyg is as of Lemma[51 

Since the restriction of Pg" on ([0, 1] , 6 ([0, 1])) is ly, 



C 



(a'" (c^«) |P^^) - £ (779 (j/) |P^^) - C {rjg (y) \iy) = N (0, Je) . 

Hence, ([55)1 is shown. 

By abusing the notation, we denote the extension of £g : il" — >■ R™ to 
f]" X rj' ^ R" also by £^: in other words, 

C(c^",:^,2/):=C(c^")- 
To verify ([5^ . we show 

^^ ('^") = %" (2/) , ^."-a.s.. (41) 

Observe that restriction of P^ to (17', A") = (M™ x [0,1], S(R" x [0,1])) is 
(l40l). Therefore, we have 



P," ({C (<i") - X}) = / / /|,„(^„)^,|P," (do.") 5,.(^„) (dx) 

./nil J^m I- »'• 1 



1, 
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and 



J M"^ "^ [0,1] 



[0,1] "'[0,1] i-'"^'^' J 

= 1. 

Thus, (|4T|) is sliown. 

By dH]) and the definition of A'", 

sup P,"{|K^'-A'"1|>£}= sup PnU-m\\>e} 
eeKnQo eeKnOo 

= sup ly {\\ve - veil > e} 
BeKnBo 

— >■ 0, n — >■ oo. 



Lemma 10 Suppose 9 ^^ pg is dijferentiable in quadratic mean, and U5\) holds. 
Then, there are probability measure Pg over a measurable space (51" x 51', A"" ® X'), 
where (51', A") := (M™ x [0, 1],6(K™ x [0,1])), n > 1, and random variables 

A'", n > 1 over (fl" x 51', A"" ® A',Pg"V smc/i t/iat, Fg" is an extension of P^ 

and 

A'"^N(0,Je), (42) 

lim F,"{||C-A'"||>£} = 0, (43) 

for any compact set K d Q. 

Proof. This is only the combination of Lemma 2.2 of [5^ and the central limit 
theorem. ■ 

Theorem 11 Suppose 6 ^ pg is continuously differentiable in quadratic mean, 
and JJ5)) holds. Also, let 0o he a countable subset ofQ. Then, there are probabil- 
ity measures Pg over measurable spaces (57" x 5}', A"" ® X'), where (5}', A"') := 
(R™ X [0, 1],6(]R'" X [0,1])), n > I, and random variables \l, n > I over 

fri" X 51', A"" ®X',Pg\, such that, Pg is an extension of Pg and 



lim sup sup 

"-*-°° heK' eeKnea 

£{Xl) = N{h,Jg'), 



pn ^n 



= 0, 
1 



Here, K is an arbitrary compact set in Q, K' is an arbitrary compact set in 
R™, and Rg (-[A") is a measure on (57" x 51', A" (g) A'), which may depend on 
0, but is independent of h. 
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Proof. We use LemmaH with / {x) = e^, i = {9, h), X„,t := /i^A'" - \h^ Jeh 
and y„,t := /i'^£^ - \h^ Jeh. Obviously, ^ and ^ arc satisfied. 
Due to (EOD, we have ^■. 

lim sup sup E^ [Ze,h (O : ^e,/i (O > a] -> 0, a ^- oo. 



Due to (|38)) , we have 

hm sup sup E',' [Ze^h (A'") : Zej, (A'") > a] 
"■^°° heK' eeKnOo 

= sup sup E"^ [Zgj^ (X) : Zgji {X) > a] — >• 0, a — >■ oo, 
h£K' eeKneo 

where £ (X) = N (O, Jg^). Thus dH]). Therefore, we have 

lim sup sup E^|Ze,/,(£^)-Z(,.4A'")|=0. 
"^°° heK' eeKneo 

Therefore, combining Lemma[Sl 

sup supE^|Z^^,-Ze.,.(A'")| 

heK' 9eK 

< sup sup E," |Z^\ - Zg^^ (C)| + sup sup E^' |Ze,,. (C) - ^e,h (A'")| 

hGK' SgK heK' eeK 



Let W^J' be the random variable with C ( W^' ] — Pg ■ Then 
E^Ze,„ (A'") /^ (W^,") 

'Zg^h{X"')lA{w^)\\"'^x 



E^ 



E2 



e 2^ -'e ^dx 
(27r)'"/'(dctJ(,)'/' 



cxp 



h^ X — —h Jgh > 7T^ T-jTT 

2 J (2^)™/'(dctJe)'/' 



E2 



I A (Wg") I A'" = Jea 



1 . ■ \T 7 /_ I,^l ("^^"^^ ^») 



exp^^-ix^h) Jgix-h)^ ^^^^^^1^ 



1/2 



da;. 



^A (vFe") I A'" - Jea 



Since fi" X f2' is Polish, there is a nice version of i?g (^|a;) := Eg 

which is a probability measure in A"" x A" for every /fc e M'" (see, for example, 
342E of m). By definition. 



E, 



gZg^u (A'") Ia [W^i) = E^^'i?^ (A|A;J) . 
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sup sup 
heK' eeK 



sup sup 
heK' eeK 



Therefore, we have the assertion: 

nzl^A (vFg") - KZe,H (A'") Ia {w^) 



= sup sup 
heK' eeK 

< sup supE^ IZ^f^ - Ze,h (A'") I ^0, n ^ oo. 
heK' eeK 



Theorem 12 Suppose 9 ^^ pg is differentiable in quadratic mean, and U5]} 
holds. Then, there are probability measures Pq over a measurable spaces (fJ" x f2', X^' 
where (f7',A") := (M™ x [0, 1],6(M™ x [0,1])), n > 1, and random variables 

XI, n> 1 over ffl" x n' , X'' (g) X' , pA , such that, P^ is an extension of P^' 

and 



hm sup 

"^°° heK 



q: 



e.h 



0, 



Q^,„ [A) := E^"i?^ {A\Xl) . 

Here, K' is an arbitrary compact set in M™, and i?g (-jA") is a measure on 
(J7" X r2'. A"" (g) X'), which may depend on 9, but is independent of h. 

Proof. The proof is parallel with the one of Theorem[TTJ except that LemmalTOl 
is used instead of Lenima[9l and that supg^g at each step is removed. ■ 

3.3 Asymptotic doner using the optimal amplifier for the 
Gaussian shift family 

Hereafter, we assume the existence of a sequence \9"'> of estimate of 9, such 
that 

> a| == 0. (44) 



lim lim Pg I \fn 
Without loss of generality, one can suppose that 



(45) 



If (|45|) is not satisfied, we redefine ^" as the closest element of n ^/^Z to ^" 
Obviously, newly defined 0" satisfies (|44|) . Therefore, letting 

we can suppose 

re Go 



~X'), 
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and the cardinality of Oq is countable. 

We consider the following procedure of (n,m)-cloner A^'J. For the compo- 
sition, we use the optimal r-amplifier Al^ — ^ /^ of the Gaussian shift family 
{N(/i, J-i)},^gjj„. Also, define 

where £(ye) = N(0,el). 

Then, for a given e > and < 6 < 1, we construct a doner A^'J as follows. 

(I) Estimate using ni-data, (rii :— 6n) and let n2 := {1 — S) n . 



(II) Apply Ainp to C {L^xl''^\Pg^ )• Denote the resulting random variable 

by^r ■- 

(III) Generate (w''",w') according to i?^" ('I"^|ii )' ^^'^ discard w'. 
The output probability distribution is 

We will show this is asymptotically optimal. 

Lemma 13 Suppose 9 ^^ pg is continuously differentiable in quadratic mean, 
and il5\) holds. Moreover, suppose il3\) is satisfied. Then, for any compact set 
K' C M", 



lim lim sup 

where 9n,h ■= + n^^^'^h. 
Proof. Define ft,„ so that 



C LV.IP," 



N (0, Jg 



0, 






{Lll\Pl^y^{Q.Jg') 



C[LV^ |P«" , -N(0,Je-i) > sup C 

"^ 1 heK' 

holds, and let 9" := 9r,,h^. Then, lim„^oo 6*" = 9. 

Denote by 4>e' the characteristic function of the distribution of Jg^ig' (W^s.k)- 
Then, the density of C (Lg;'^|PJ*„) with respect to Lebesgue measure is 



1 

2^ 



Mt. 



Observe 



e s"^" " e 



-It-a; 



dt< e 



dt < cx). 
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Hence, by Lebesgue's dominated convergence theorem, we have, with /rem being 
as of (fTSl). 



hm — 

n— foo 27r 



— / hm 



t 



-,-ie t %,-\/^Tt-2; 



di 



e-2^ll*ll e-^^*'^di. 



h J }^L { 1 - i (^"^- *) + /- (^' ^^' ") }" 



e-5e|l*re^^/^*'^ 



"di 



27r 
= ^ /'exp|-ii^(j,-i+e2i)t|e-^^*-dt a.e. 

Here, in the third hne, we used Lemma[3]to show that the first order term of the 
Taylor expansion (= Eg£g) vanishes. Also, to obtain the fourth line, we used 
the inequality p^ . 

Therefore, the density of C {L^^\Pg\) converges to the one of N (O, Jg^ + e) , 
as n — >■ oo. Therefore, By Schefe's lemma, we have 

hm \\C {L;''\P^,.) - N (0, J-i + e) 111 = 0. 



Therefore, 

lim lim ||£(i"f|Pe"„)-N(0,J-M|L 

< lim lim ||£ (ie,f |Pj;0 - N (O, Jg^ + e)||i + 1™ ||N (O, J~^) - N (O, J-^ + e) ||^ 



Therefore, 



lim lim sup 



^{LZJPQ-^i^^J^') 



<e'. 



Since e' > is arbitrary, we have the assertion. 



Lemma 14 Suppose ^ pg is continuously differentiable in quadratic mean, 
and U5\) holds. Moreover, we suppose US]) and Jj^p hold. Then, for any com- 
pact set K' G K™, we have 



lim lim sup 



c 



{LZ.\Pe)-^{~h,Jg') 



0, 



where 0n,h := 9 + n ^/^/i 

Proof. Observe, for any measurable function / with sup^^jj™ |/ {x)\ < 1, 



E^=E2 



/(^'.rO 



= E^^ES 



•^ V'^e^^'J ^^".'' -'' 
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Observe also, due to Leinnia[Sl with Kg being a compact subset of <d containing 
9 and K' being an arbitrary compact subset of E™, 



sup 



< sup K. . 



heK' 






< sup sup E,", [\Z^,^_^ - Ze'.-K (CO I ] 

/iG-ff'e'G-ffe 

— ?> 0, n — !> oo. 
Therefore, we have to evaluate 

hm sup E^^E','^ ^ [/ [lY;\ Z,„ „_^ (C„ , 



(46) 



lim sup E^'E^„ ^ [/ iLY\ Z,„,„_, [Jb^^.LY^, 



n,e ^ h Jb^^Ye 



lim sup {^1 + ^2 + ^3} , 



where 



£^3 := E'-^ES 



III "n.li ||— ■ " ="— J ^ ^ ^ ' 

I 



III "n.h II J ^ ' ^ ' 

The first term of the right most side of £'1 is evaluated as follows. 



Y, 



El = e^-e; 



YcT^n 



^{IIl,"- IkalJ" [^Z,h) ^e^.^^~h (je„,,Le:'jE 



I "n.hll- J 

whose second factor can be evaluated as 



lim lim sup 



E 



-^{||Y,||<ei/2]. 



< lim lim sup e 



I'^ll •^»„ Jk 



e 

1/4 



''"'"'«„ h"^ 



= 



{|y,|<£i/i}e 
(47) 



(48) 



h.h^ „n 






To evaluate the first factor of Ei , or 



£'11 :— E 'Eg 



|||l"'" ||<a) 

III "n.hll- J 



a)-^ (-^e:!J Ze„,^,-h [Je^^LZ^j 
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observe 



^{||L-J|<a}/(^«.,.)^^-''( 



lim sup El 1 - E^'E'e' 

< lim sup sup IZg^^^^h (Je^^L) ~ Ze-h {JeL)\ 

"^°°heA-' ||L||<a 



JeLn 



lim sup sup 

"■^°°heK' \\L\\<a 



Tr^ r^ e^''"^«.,." -expl-Zi^JsLJe^''"^'''^ 



exp{-/i^Je^ ,^L} 



= 0. 



Therefore, letting Xh be a random variable with £ (Xh) = N (/i, Jg ^), 



lim lim sup LBi,i-E^-M/(^-h);||^-h|| < a]\ 



lim lim sup 

eiO n-i-oo ^g^, 



Y?'-Wa 



< sup ell'^llll-^fll'^e^s'' "'"''lim lim sup 
= 0, 

where the last identity is due to Leinma [T51 
Therefore, by (p| and (|49l). 



c (lV. |p«" 



J n.s 

< a 



< a 



)-N(0,J-i) 



lim lim sup |Si - E [/ (X_^) ; ||X_,,|| < a]| = 0. 



(49) 



(50) 



On the other hand, by pT)) . _E2the second term of the right most side of PSJ) 
is evaluated as 

lim lim sup E2 < lim sup E^'E^ ^ f^e„ .,-h fe J : ll^'ell > e'' 

e^O n-s-oo ^g^/ n^oo ,jg^, "■ L ' V "• / 

= limPr|||n|| >ei/H- lim sup e^'^^^-.'-^-^''^''^".'.'' 



0. 



•heK' 



(51) 
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Also, E^ is evaluated as, by ([T7|) . 



lim lim sup E^ 

< lim lim sup E^^Eg ^ 



Ze 



,'«-'« l*e„,h 



< lim lim sup Eg 






< lim lim < / sup Pn^ \ 



^'i 



> a,„,, (a - £1/4) E',',^^,^ 



y„.h-ri \''er,,h 



< lim lim , / sup P" ( ^"" >ag , (a - eV*) \ 



. g "n.h g "n.h 



< lim lim. , / sup 

eiO n^oo Y f^^j^, 1^^^^ (-^ _ gl/4) } 



En 



/i^Je ,/i 



< \ HA sup e'*"''^"'', 

where ag is the m.inimal eigenvalue of Jg. 

After all, combining (gH), ([301), dSIl) and ((SH), we have 



(52) 



lim lim sup 

£^0 n-i-oo ^g^, 



E^'EL' 



< lim lim sup 

e;0 n->oo ^g^, 



E^^E^ 



/(l^;^J]-e[/(x_,0] 

/ (l^;^J z,„,„_, (r,'„ J] - E [/ (x_,o] 



/tr Je 

o „ sup e 



h^Jgh 



sup Pr{|lX_,,|l >a}. 



/iSAT' 



Since a is arbitrary, letting a — >■ oo, we have 



lim lim sup 



^fej^«")-N(-/^,J.^^) 



Theorem 15 Suppose 6 ^ pg is continuously differentiable in quadratic mean, 
and il5\) holds. Moreover, we suppose il3\) . (I^, and ^J^ hold. Then, we have 
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Proof. Observe, for any compact set K' C 



^YAK)-Pt 



< 

< E' 

< E' 

+ E' 






. O^^-O 



E^S"iRZ, (-IXI' 



prn 
fjrn 

E^F".i?^:'^(.|lr'„J-P™ 

E^^-i?^::,(-ixi'„,)-pr 



n2 
n2 



The second term of (l53l) is evaluated as 



lim E" 



^{||E^?".i?™ (.|ll'„J 



pr 






(ri - 6iW A"' I 



(53) 



< 2 lim Pg' I V^ f^"! - 6'W AT'I , 



whose left hand side becomes arbitrarily small as K' f K™, due to pi)) . 
Next, we evaluate the first term of (l53l). 



E«"^ 
< E" " 



E*»""i i?^:.\ (-i^^ii) - ^r|| : v^ (^"' - ^) e X' 



E^«""i i?' 



™ (-i^^^O -^^-^,y^(«-«-)IL ^ ^(^" -^) 






pr 



r^"! - e\ 



eK' 



The first term of ([54| is evaluated as follows. Let 



or equivalently, 



^712.11 



eK' 



(54) 



,,/i' 
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where h :— y r [1 — 6) h. Then, 

?Xs7i, urn 



sup 

A 



sup 

A 

sup 

A 



< 



< 



E^^-i?;-:\ [a\x^„^)~e'-^ry:, (i|A™) 

cixi 



A£l^{N{~h,J,')) 



^/r/{l-S) 



A^mu'^ "' iN{-h,Jg^))-N(-h,J^^ 



A, 



aXS^(N(-^J-l)) 



< 






+ sup 

1 h'SR"" 



AaXj?^ (N {h', J-')) N (Vr/(l-<5)/.', J,-i) 



Therefore, due to Lemnia[T4l 



hm hm E"" 



sup 

1 



; v"-2 



eif' 



< hm hm sup 



+ sup sup 



A; 



sup 

/leR" 






A^£F^ (N (/i, J-i)) - N {Vr/il-S)f 



D 



r/(l--5).J- 



(55) 



The second term of (151)) is evaluated as fohows. Let K' be an arbitrary 
compact set in R™ and Kg be an arbitrary compact set in 6 with 9 E K. Then, 
due to (gS]) and TheoremfTTl 



E^"^ 



< sup sup 

9'eKe heK' 



fr^ -e\ e K' 

> 0, n — ^ oo. 



B',-h ^ ^0'-h/^¥^ 

Therefore, combining (|55|) and ([56| . we have 

hm li^ E''"' \ E^«""i i?^" f -ll? , ) - PJ-" : ^ij f^"! - 0) G i^' 



(56) 



< D 



r/(l-S),J- 
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After all, we have 



lim lim 



K;: (Pe) - pr 



< D 



r/{l~S),J- 



Since the map x — > D^^y. is continuous about x (see 
have the asserted result. ■ 



letting (5 — >■ 0, we 



3.4 Local minimax property 

Based on (n, rn)-cloner A"'*" for {PJ^Iggg,, we compose an amplifier Aainp'"'^ 
for the Gaussian shift {N (ft,, ^e^^)}/,^™™ as follows. 

(I) Given Xh with C {Xh) — N (/i, Jg"^), compose 

QT,K {A) := Ql>,n {A x n') ^ Y.^'-BJ^ {A x ^'\X^) . 

(II) Apply A"-'- to Qf,^. Denote by Wj^''' the random variable with £ {Wj^''") = 

(III) The output random variable is A^^'"'^ := i™'^ (Wh'^)^ where L^'^ (cj") := 
JgH"^ (w") + n and C {¥,) = N (0, e). 

Lemma 16 Suppose 6 ~-> pg is differentiable in quadratic mean, and Iil5\) and 
|J^[) hold. Then, for any compact set K' G M™, we have 



lim sup 



^(irinij-N(ft,Je-^) 



==0. 



Proof. Observe, for any measurable function / with supj.gj{m |/ {x)\ < 1, 
Observe also, due to Lemma[Sl with K' being an arbitrary compact subset of 



sup |E^^E^ [/ (LH (^e\ - ^«,4C) )] I 



hGK' 



(57) 



heK' 



— >■ 0, n — > oo. 
Therefore, we have to evaluate 



lim lim sup E^=En/(ie'')^e.'^ (C)] 



lim lim sup E^^Eg 



f {L'g'^)Zg^h (J0ig'^)e 



n.e\ -h' JgY, 



= lim lim sup [Ei + E2 + E3) , 
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where 

E2 := E^'E^' 
E. := E^'EL' 



^{\\V^'^\\<aA\Y,\\<e^/-i}f^^V)^S:h{JeLV)e ^ ■'"^^ 



'{||y.||>ei/4} 



i/4l./('^e' ) ^0,/i {JeLg'' )e 



n,£^ „-/i' Jen 



^{\\L'^''\\>a,\\Y,\\<e^/'^}f(^V)^9,h{JeL'g'')e ^ ''"^'^ 



El is evaluated as follows. Observe 

El ^E'^-E^'^^ ^/|||^„,e||<^|/(Lg'^)Ze,h (J9Lg'^)E [/{||y^||<ei/4]. 
whose second factor can be evaluated as 
E 



-h' JgY, 



lim lim sup 



^{linBeV.}e-''^'^«- 



i^ 



1 



< el 



h||||.7,||ei/* 



To evaluate the first factor 

Ei,i :== E^»E," [/ (r;'^) Z,^^ (JeLr) : ||i,"'1l < a] , 
observe, with C (Xh) = N (ft, J^"^), 

lim lim sup \Ei^i - E [/ (X_,0 : \\X^h\\ < a]\ 



lim lim sup 



E^»E«[/(ir)^«.'.(^^ir):||iMI< 
-E^o [/(Xo) Zg^ {JgX„) : \\Xo\\ < a] 



< sup ell''llll''''ll''-^''''-'<'Mim lim ||£ (L"'''|P") - N (O, J."^) 11 
= 0, 

where the last identity is due to LemmalTSl 
Therefore, by ^ and ^, 



lim lim sup \Ei - E [/ (X.^) : \\X.h\\ < a]| = 0. 



On the other hand, by (jT?)) . 
lim lim sup i?2 



< lim lim sup E^'E^ Zg ,, (ig) : \\Ye\\ > e^'^ 
= limPr|||i;|| >e^/*| • sup ^^'^ Jeh^-\h^ Joh 






(58) 



(59) 



(60) 



(61) 
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and 



lim lim sup E^ 

e^O n-s-oo ^^g^, 

< lim lim sup E^^Eg 

< lim lim sup Eg /i 

< lim lim sup 



.1/2' 



Ze,,.(C):||ini>«Jln||<e 
', V^e" {IICII > «4« - e'/')}\/E," [ZoM {t^Df 



< lim lim J sup P." IIICII > "e (« 



-el/4)} gyp E^,e"^7^ 






< lim lim 



\//feT{a,(a-£i/4)}^ 



^E'g'p^ll^ sup e'^'^Jn'' 

heK' 



^\b''B.7^ 



sup e^'-^-^"^. 






After all, by ([571), dSOl), dSU, and ([52]), we have 

'5^^E^^J/(L,-^)]-E[/(X,0] 



lim lim sup 



= lim lim sup |E^^E',' [/ (L^'^) Ze,h (C)] - E [/ (X;,)]| 



= J sup %-^ sup e''^-^"'' + sup Pr{||X/,|| > a}. 

V heK' O^gU h(zK' heK' 



Since a is arbitrary, letting a — >■ oo, we have 



lim lim sup 



c 



(LV\Pl,)-^{KJe') 



= 0. 



(62) 



Theorem 17 Suppose 9 -^ pg is dijjerentiable in quadratic mean, and 1115]) and 
|i^[) hold. Then, for any Markov map A"'*" and for any 9 € Q, we have UU\). 
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Proof. Observe 

ALf '"'^ (N {h, J^')) - N {V^h, J-i) 



< 






c 



< 
< 

+ 
< 



\7i,r I i^ln \ prn 



C 



A 









^(L7''\Pe:j-^iV^h,J-') 



e.h ^9„ 



A 



""(^^,0 



pr 



^iL7''\Po:\)-^{v^h,J^'] 



By Theoreni[T2|the first term vanishes, 



lim sup 



yn pn 

ie,h ~ ^e„ 



By Lemma [TBI since 9n,h — 0- 



rrij-yrh^ 



the third term vanishes, 



lim Km sup 



c 



{L7^'\Pe:.)-^{V^h,J-') 



= 0. 



After all, we have 



lim lim sup 

E^O n_>oo heK' 



ALf '"'^ (N {h, J^')) - N (V^/i, J-i) 



< lim sup 

1 n— :-oo h^K' 



A' 



;,r / pn \ 



Since 



inf sup 



A^;;^(N(/.,J,-i))-N(V^/;„J,-i) 



< lim sup 

1 n—^oo hGK' 



Al^'"'^ (N {h, J,-i)) - N {V^h, J,') 



9.^ 



holds due to optimality of Aainp , we have 



lim sup 

n— ^oo h(^K' 



A" 



{Pel.) 



pr 
^0 



> inf sup 

1 A heK' 



Alf (N(/i,J-i))-N(V?/i,J,-^) 



Here, letting K' = {x; \\x\\ < a} and a — >■ oo, we have (fTO|) . ■ 

4 Discussion 

Using quantum LAN, we can produce similar results for finite dimensional quan- 
tum system. 
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A Proof of (E]) 

In this appendix, we prove 

inf Ibo.i -Px,ri\\i = \\po,i (y) -po,ri{y)\\i, 
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where Px,T, is the density of N(x, S). Due to the symmetry, we can suppose 
a; = (i,0, • • • ,0),i > 0. Define Br,t ■= {y;Po,i (j/) > Px,ri (y)}- Observe 

y(^ Br 

^ ' K=2 ^ 

Hence, B^ is a baU. 

For z e R™^i and f G M, define ii and t2 by 

Po,i ((^K, z)) ^ po,ri ((is - t, z)) , 

tl < t2. 

One can verify 

PO,l((^l>^)) >P0,l((*2,2)) 

as follows. In case of < ii {t,z) < ^2 (^, ^), this holds because po.i {{-yz)) 
is monotone decreasing on IR+. In case of ti {t,z) < < t2{t,z), observe 
ti (0, z) < h (i, z) <0<t2 (0, z) < t2 [t, z). Hence, 

Po,i ((^1 (i, z) , z)) > po,i ((^1 (0, z) , z)) = po,i ((^2 (0, z) , z)) > po,i ((^2 {t, z) , z)) . 

Therefore, 

d 



^^ bo,l -Pa^.rllli = / {po,l((*l>^)) --PO.I ((i2,2;))}dz > 0. 

Therefore, the minimum is achieved t = 0, and we have the asserted result. 
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